participatory personalization
Participatory Personalization in Classification Supplementary Material
The performance of participatory systems will depend on individual reporting decisions. Thus, flat and sequential systems will perform better than a minimal system. The best-case performance of any participatory system will exceed the performance of any of its components. Given a participatory system, we can conduct this evaluation by simulating the parameters in the individual disclosure model shown above. The sequential system outperforms static personalized systems when all group attributes are reported.
- North America > United States > California (0.04)
- North America > United States > New Jersey (0.04)
- North America > United States > Louisiana (0.04)
- North America > United States > Kentucky (0.04)
Participatory Personalization in Classification
Machine learning models are often personalized based on information that is protected, sensitive, self-reported, or costly to acquire. These models use information about people, but do not facilitate nor inform their . Individuals cannot opt out of reporting information that a model needs to personalize their predictions nor tell if they benefit from personalization in the first place. We introduce a new family of prediction models, called participatory systems, that let individuals opt into personalization at prediction time. We present a model-agnostic algorithm to learn participatory systems for supervised learning tasks where models are personalized with categorical group attributes. We conduct a comprehensive empirical study of participatory systems in clinical prediction tasks, comparing them to common approaches for personalization and imputation. Our results show that participatory systems can facilitate and inform consent in a way that improves performance and privacy across all groups who report personal data.
Participatory Personalization in Classification Supplementary Material
The performance of participatory systems will depend on individual reporting decisions. Thus, flat and sequential systems will perform better than a minimal system. The best-case performance of any participatory system will exceed the performance of any of its components. Given a participatory system, we can conduct this evaluation by simulating the parameters in the individual disclosure model shown above. The sequential system outperforms static personalized systems when all group attributes are reported.
- North America > United States > California (0.04)
- North America > United States > New Jersey (0.04)
- North America > United States > Louisiana (0.04)
- North America > United States > Kentucky (0.04)
Participatory Personalization in Classification
Machine learning models are often personalized based on information that is protected, sensitive, self-reported, or costly to acquire. These models use information about people, but do not facilitate nor inform their consent. Individuals cannot opt out of reporting information that a model needs to personalize their predictions nor tell if they benefit from personalization in the first place. We introduce a new family of prediction models, called participatory systems, that let individuals opt into personalization at prediction time. We present a model-agnostic algorithm to learn participatory systems for supervised learning tasks where models are personalized with categorical group attributes.
Participatory Personalization in Classification
Joren, Hailey, Nagpal, Chirag, Heller, Katherine, Ustun, Berk
Machine learning models are often personalized with information that is protected, sensitive, self-reported, or costly to acquire. These models use information about people but do not facilitate nor inform their consent. Individuals cannot opt out of reporting personal information to a model, nor tell if they benefit from personalization in the first place. We introduce a family of classification models, called participatory systems, that let individuals opt into personalization at prediction time. We present a model-agnostic algorithm to learn participatory systems for personalization with categorical group attributes. We conduct a comprehensive empirical study of participatory systems in clinical prediction tasks, benchmarking them with common approaches for personalization and imputation. Our results demonstrate that participatory systems can facilitate and inform consent while improving performance and data use across all groups who report personal data.